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Abstract:  An  important  part  of  stereo  vision  consists  of  finding  and  matching  points  in 
two  images  which  correspond  to  the  same  physical  element  in  the  scene.  We  show  that 
zeros  of  curvature  of  curves  are  perspective  projection  invariants  and  can  therefore  be 
used  to  find  corresponding  points.  They  can  be  us^  to  help  solve  the  registration  problem 
(Longuet-Higgins,  1982)  and  to  obtain  the  correct  depth  when  a  curve  enters  the  forbidden 
zone  (Krol  and  van  de  Grind,  1982).  They  are  also  relevant  to  theories  lor  representing 
image  curves.  We  consider  the  stability  of  these  zeros  of  curvature. 
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Perspective  Projection  Invariants 


The  goal  of  stereopsis  in  computer  vision  is  the  recovery  of  the  3D  structure  of  a  scene, 
given  two  different  images  of  it.  This  recovery  is  preceeded  by  the  search  for  corresponding 
features  of  the  two  images,  that  is  to  say  features  that  correspond  to  the  same  physical 
elements  in  the  scene  (1,17). 


If  the  two  images  are  taken  from  two  close  points  of  view,  they  will  typically  be  just 
slightly  different:  then  standard  correlation  techniques  can  identify  corresponding  elements 
(2, 3, 4, 5,6,7 ,8).  Once  this  correspondence  has  been  obtained,  triangulation  methods  allow 
the  3D  reconstruction  of  the  scene.  It  can  be  shown  that  in  this  case  the  error  made  in  the 
reconstruction  is  large,  while  if  the  two  images  are  taken  from  two  very  different  points  of 
view  the  error  is  smaller  (9).  However  when  the  two  images  are  taken  from  points  of  view  far 
apart  from  each  other  they  will  look  very  different  and  standard  correlation  techniques  will 
fail  in  the  search  for  corresponding  elements.  This  search,  therefore,  must  be  guided  by  new 
rules,  taking  into  account  features  having  invariant  properties  under  arbitrary  perspective 
projections.  Such  invariant  features  will  project  to  corresponding  points  in  the  two  images. 


Epipolar  lines  in  the  two  images  are  lines  on  which  corresponding  points  lie.  The  projections 
of  a  point  P  in  space  lie  on  the  plane  defined  by  P  and  the  two  camera  foci  and  hence 
on  the  two  lines  defined  by  the  intersection  of  this  plane  with  the  two  image  planes  (see 
figure  1). 

If  the  epipolar  lines  are  known  the  matching  problem  is  reduced  to  a  one-dimensional 
search.  Moreover  the  ordering  of  edges,  or  other  features,  is  usually  preserved  along 
epipolar  lines.  Many  stereo  algorithms  make  use  of  the  ordering  constraint  along  epipolar 
lines.  This  ordering  constraint  is  violated  for  an  object  in  the  "forbidden  zone"  (14,  15,  16). 
If  a  point  B  lies  in  the  forbidden  zone  of  a  point  A  and  the  two  points  are  connected  by  2m 
opaque  surface  then  the  two  images  would  see  opposite  sides  of  the  surface  (see  figure 
2). 

To  determine  the  epipolar  lines  we  must  find  the  camera  geometry  by  registering  the 
image.  Longuet-Higgins  (1982)  has  described  a  method  for  solving  the  registration  problem 
assuming  that  three  corresponding  points  in  the  two  images  are  known.  Perspective 
invariants  project  to  corresponding  points  in  the  two  images  and  hence  could  be  used  to 
solve  this  problem.  They  could  also  be  used  as  consistency  checks  to  see  if  the  ordering 
constraint  is  violated.  When  the  object  enters  the  forbidden  zone  the  ordering  constraint  will 
give  false  matches.  These  false  matches  could  be  detected  if  we  could  find  corresponding 
points.  _  I - 
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Figure  1.  See  text. 

In  this  note  we  prove  that  points  of  zero  curvature  of  planar  curves  are  "perspective 
invariants"  and  that  points  of  zero  curvature  of  non  planar  curves  are  alnH>8t  always 
"perspective  invariants"  with  the  exception  of  non  generic  cases(10).  Moreover  we  briefly 
analyze  the  stability  in  20  and  30  of  such  points,  considered  as  zeros  of  curvature.  We 
show  that  the  zeros  of  curvature  of  planar  curves  are  structurally  stable  for  a  20  deformation 
(one  lying  on  the  plane  of  the  curve)  but  not  for  a  30  one.  Since  protections  map  30  curves 
into  20  ones,  however,  projections  of  almost  planar  curves  show  some  stability  properties. 
On  the  contrary,  zeros  of  curvature  of  arbibary  30  curves  do  not  present  any  simple  kind 
of  stability. 

Thus  zeros  of  curvature  of  planar  or  almost  planar  curves  are  features  that  can  be 
successfully  used  in  solving  the  "correspondence  problem"  in  stereopsis  when  the  scene 
is  observed  from  two  very  different  points  of  view.  Since  zeros  of  curvature  in  two  images 
correspond  they  can  be  used  to  solve  the  registration  problem  for  stereo  (13).  The  projection 
invariants  of  zeros  of  curvature  and  the  constraint  that  matches  take  place  between  points 
on  corresponding  epipolar  lines  have  been  used  to  construct  an  algorithm  able  to  solve 
the  correspondence  problem  for  arbitrary  20  curves  even  when  the  ordering  constraint  is 
violated  (11). 

Recent  work  on  representing  image  curves  involves  filtering  the  curve  with  gaussians  of 
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Figure  2.  See  text 

different  sizes  to  obtain  a  multiscale  description  which  can  be  interpreted  in  terms  of  a 
small  set  of  primitives  thereby  producing  a  curvature  primal  sketch  (18).  Marimont  (19) 
considers  planar  curves  projected  orthographically  onto  the  viewing  plane.  He  suggests 
using  zeros  and  extrema  of  curvature  as  primitives  because  of  their  invariance,  and 
approximate  invariance,  under  change  of  viewpoint.  Zeros  of  curvature  of  the  curve  are 
moreover  preserved  when  the  curve  is  convolved  with  a  gaussian  filter.  The  results  in  this 
paper  extend  this  work  by  showing  that  zeros  of  curvature  are  invariants  even  when  the 
curve  is  non-planar  and  the  projection  is  perspective. 

Section  1 . 

Let  <7  be  a  curve  in  the  30  space  and  7^  its  perspective  projection  with  respect  to  a  focus 
O  on  a  plane  e.  Let  /  be  the  focal  length,  the  distance  between  O  and 

If  we  introduce  a  system  of  coordinates  (x,  y,  z)  centered  on  O  then  7  will  be  described  by 
the  vector  valued  function  x(/i)  =  (x(4),  y(«),  s(«))  where  «,  the  arc  length  of  7,  varies  in  a 
given  interval  [a,  6]  of  It  and  7p  by  z,  =  x^{a).  It  is  easy  to  see  that  the  following  relationship 
holds  between  Zp  and  z  (see  fig. 3) 
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Figur*  3.  See  text 

where  a  is  the  unit  normal  vector  to  the  projection  plane  notice  that  a  •  a  7^  0  for  all  • 
since  we  suppose  that  the  perspective  projection  exists. 

From  now  on  T(T,)  will  indicate  the  unit  tangent  vector  to  the  curve  (projected  cunre), 
N{N,)  the  unit  normal  to  the  curve  (projected  curve)  and  B{B,)  the  unit  binormal  to  the 
curve  (projected  curve).  Suppose  moreovw  that  each  component  of  z(a)  is  a  function  twice 
differentiable  with  respect  to  «. 

From  elementary  differential  geometry  we  have: 

('*) 

where  «(«)  is  the  curvature  of  7  at  the  point  z(«)  and: 

M-x)  =  11^^11  (‘■3) 

where  >Cp(jtp)  is  the  curvature  of  at  the  point  Xp(Mp) ,  with  »p  being  the  arc  length  of  7,. 
Now  let  us  compute  Xp.  It  »  easy  to  see  that: 
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/ 

d*  (la)* 


1 


(1.4) 


where 


Z  =  fl  X  (Z  X  *). 


(1.5) 


Since  s,  is  the  arc  length  of 


r  T 

dSf  '  da,  da  da  \da,J 

and  hence 


(1,6) 


da  (x  •  o)*  1 
ds,  -  f  \1\- 


Notice  that  (1 .7)  holds  if 


and  that  (1.8a)  always  holds  (see  (1.3))  unless* 


I  II  *• 


Now 


(1.80) 


(1.85) 


(1.9) 


and 


k,K,^ 


da. 


da  da,’ 


Substituting  (1.9),  (1.7)  and  (1.3)  in  (1.10)  gives 


=  da 


(AYllPl 

m)  f 


2 

III 


(1. 10) 


(I. II) 


but _ 

'If  this  condition  is  not  satisfied  then  a  cusp  will  typically  be  generated  in  7^. 
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and  80 


k^K,= 


Notice  that 


U 

da 


•cL 


(1.12) 


(1.13) 


(1.14) 


where  we  set 


L^aXiKx^.  (1.15) 

So  (l.l3)i)ecoines 

=  (1.16) 

where  we  eet 


K  =  £x(LxD.  (1.17) 

Notice  that  jM|  =  0  if  and  only  if  for  some  real  number  p.  This  can  easily  be  seen 

from  (1.17);  looking  at  (1.5)  and  (1.14)  it  is  obvious  that  such  a  p  Mcists  if  and  only  If  z.2^,2I 
are  coplanar,  that  is  if  and  only  if  c  *  x  £  =  0  (we  ignore  the  possibility  that  o  ■  a  =  0 
since  in  this  case  the  eye  cannot  see  the  point). 

Now  we  can  prove  the  following  theorems. 

Theorem  1 . 

Let  7  be  a  aimpie  planar  curve  and  7^  its  perspective  protection  onto  a  plane  0  with  respect 
to  a  focus  O.  Let  us  use  the  same  rtotation  and  hypotheses  as  above.  Then:  for  every  « 
for  which  k  is  defined  is  also  defined.  Moreover,  whenever  there  exists  an  «o  such  that 
<c(«o)  =z  0  then  4Cf<(«o)  ^  0  and  vice  versa. 

Proof 

Notice  that  for  a  planar  curve  for  which  a  perspective  projection  with  respect  to  a  focus  O 
Mcisti,  z  -  ^  X  r  /  0  for  all  /<,  since  the  plane  containing  the  curve  does  not  pass  through 
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rigur*  4.  See  text. 

the  point  O.  Hence  (1.8a)  and  (1.8b)  always  hold,  thus  (1.16)  holds  as  well  and  the  first 
statement  of  the  theorem  is  proved. 

Moreover  from  (1.16)  it  follows  immediately  that  when  there  exists  an  aq  such  that  ic(«o)  =  0 
then  K,(«o)  =  0.  The  converse  is  also  true  since  in  the  right  hand  side  of  (1 .16)  (s  a)*  >  0  for 
all  s  by  hypotheses  and  \M.\  ^  0  because  as  mentioned  above  z,  K,  Z  cannot  be  coplanar. 
So  if  K,{ao)  =  0  (1.17)  holds  if  K(ao)  =  0- 

Theorem  2 

Let  us  suppose  that  7  is  a  generic  non  planar  curve  and  -\p  its  perspective  projection  with 
respect  to  a  focus  O  on  a  plane  Then  with  the  same  notation  and  hypotheses  as  above: 
for  every  »  for  which  k  is  defined  and  unless  Z  ||  s  then  Kp  is  defined.  Moreover  whenever 
there  exists  such  that  k(«o)  =  0  then  Kp(ap)  =  0  (see  fig.4). 

Proof 

Notice  that  for  any  curve  (1.8a)  holds  if  (1.8b)  holds,  that  is  it  holds  unless  Z  ||  z.  Then 
from  the  hypotheses  of  the  theorem  the  proof  follows  directly  from  (1.16). 

Theorem  3 


7 
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Figure  S.  See  text 

With  the  same  hypotheses  as  ttieorem  2  a  necessary  and  sufBcient  conc^tion  for  mere  to 
exist  an  •«  such  K,(ae) »  0  v«Mie  i^ae)  yt  0  is  that  z(*o) '  x  T(a«)  =  0. 

Proof 

The  theorem  is  an  direct  consequence  of  the  fact  that,  by  the  hypotheses  of  theorem  2, 
(r.i6)  holds  and  that  |M(«o)l  -■  0  if  and  only  if  z(«o).  lUit)  and  K«o)  are  coplanar. 

Theorem  1  says  that  for  any  plarar  curve  points  of  zero  curvature  are  preserved  under 
arbitrary  perspective  projection:  theorem  2  says  that  for  arbitrary  curves  points  of  zero 
curvature  are  transformed  into  points  of  zero  curvature  of  the  projected  curve.  The  converse, 
as  shown  in  theorem  3>  is  true  except  for  the  case  in  which  z,  K  and  Z  are  coplanar  (see 
fig.5). 

.  This  case,  however,  is  non  generic  since  a  small  displacement  of  the  focus  of  pn^tion 
will  destroy  the  coplanarity. 

It  is  worth  noticuYg  that  even  cusps  have  the  same  properly  of  invariance,  but  as 
discontinuities  of  the  curvature  they  are  not  ea»ly  identified  in  computer  implementation 
(whUe  zeros  of  curvature  are). 

Section  2. 

In  this  section  we  discuss  the  stability  of  20  and  30  zeros  of  curvature.  Before  starting  the 
discussion  let  us  summarize  some  elemenlary  results  of  differential  geometry  (12). 
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Let  7  be  a  smooth  curve  lying  on  a  smooth  surface.  The  component  of  the  curvature  vector 
d^x.lds^  along  the  direction  of  the  surface  normal  is  called  the  normal  curvature.  Therefore 
if  n  is  the  unit  vector  normal  to  the  surface  and  /c„  the  normal  curvature,  then  for  every  « 
we  have; 

^  •  n  =  n.  (2.1) 

Moreover  the  component  of  the  curvature  vector  along  the  unit  vector  u,  orthogonal  to  the 
surface  normal  and  such  that  jt  •  (a  X  iV)  =  0  is  called  the  geodesic  curvature.  It  is  easy 
to  see  that  the  geodesic  curvature  at  a  point  is  equal  to  the  ordinary  curvature  times  the 
cosine  of  the  angle  0  between  the  osculating  plane  to  the  curve  (the  plane  through  the 
point  containing  the  tangent  and  normal  vectors  to  the  curve)  and  the  tangent  plane  to  the 
surface.  Therefore,  if  k,  is  the  geodesic  curvature,  for  every  »  we  have: 

Kg  —  KCO30  (2.2) 

and  clearly: 

K*  *=«*  +«*.  (2.3) 

It  is  clear  that  k„  must  have  a  maximum  kj  and  a  minimum  kz,  called  the  first  and  second 
principal  curvatures  respectively,  since  it  is  a  continuous  function  on  a  closed  bounded 
set.  Moreover  the  directions  of  the  two  principal  curvatures  are  mutually  orthogonal  and  if 
4>  is  the  angle  between  the  tangent  to  the  curve  2Uid  the  first  principal  curvature  we  have: 

=  Kicoa^^  +  »cz«m*^.  (2.4) 

This  relationship  will  be  useful  later  on,  since  it  suggests  examples  of  surfaces  on  which 

no  curve  can  show  zeros  of  k„  and  therefore  no  zeros  of  curvature  at  all. 

Consider  now  the  set  r  of  curves  in  the  x,y  plane  with  only  one  zero  of  curvature.  It  can 
be  defined  as  follows:  7cr  if  its  parametric  equations  x  =  i(a),  y  =  ;/(»)  are  continuous  with 
derivatives  continuous  up  to  every  order:  moreover 

I  (2.5) 


for  every  «  and 
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*"*  +  y"*  5^  0  (2.8) 

for  every  ao,  where  ao  is  the  point  of  zero  curvature. 

At  the  point  (x(ao),  y(ao))  7  has  a  zero  of  curvature  and  in  consequence  the  normal  and  the 
binormal  to  that  curve  at  that  point  are  not  well  defined.  For  a  planar  curve  the  normal 
vector  to  a  curve  can  be  defined  to  be  the  unit  vector  lying  in  the  plane  perpendicular  to 
the  tangent.  Since  the  functions  x  and  y  have  continuous  second  derivatives  the  left  and 
right  limits  of  the  unit  normal  as  a  goes  to  «o  must  exist,  for  when  a  =  ao: 


K 


=( 


) 


(2.7) 


Moreover  these  two  limits,  not  necessarily  coincident,  aliow  the  existence  of  the  foilowing 
vector  product  iimits: 


X  i)£.(*)  —  £(ao)+ 


<»m,«„_I(a)  X  K{a)  =  J2(«o)-  (2.8) 

since 


B.{a)  =  4')  X  K{a). 
But 


(2.9) 


I 

I 

1 

I 


l(»)m«)  =  o 


(2.10) 


for  every  « ^  «o  and  so 


H(aoU  •  m»o)- ±l 


(2.10) 


or  equivalently 


N.{aa)+  K(ao)-  =  ±1  (2.11) 

where  /y(/i„)>.  and  A^(a„)  are  respectively  the  right  and  left  limits  of  the  unit  normal  for 


A  Il0» 
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Expression  (2.10)  is  more  usefui  than  (2.11),  since  for  a  planar  curve  the  direction  of  the : 
binormal  is  constant.  So  at  such  points  the  limit  of  the  binormal  can  change  sign  and 
therefore  we  can  arbitrarily  set  the  value  of  the  sign  of  the  curvature  at  a  given  point  where 
K  ^  0  and  then  detect  and  define  a  change  of  sign  whenever  the  binormal,  or  rather  its 
limit  expression,  changes  its  sign. 

We  now  make  use  of  Morse  theory  (10).  Intuitiveiy  if  the  zero  of  a  function  /(x)  is  a  zero 
crossing  (in  other  words  if  the  function  changes  sign  at  the  zero)  then  a  small  perturbation 
of  the  function  will  not  alter  the  existence  of  such  a  zero,  although  it  may  move  its  position. 
The  zero  is  then  said  to  be  stable.  Moreover  most  zeros  of  functions  are  zero  crossings.  This 
can  be  contrasted  with  the  behaviour  of  a  function  like  ^(x)  =  x*  which  has  a  zero,  but  not  a 
zero  crossing,  at  x  =  0.  A  small  pertuiiaation  of  ^(x),  such  as  adding  an  infinitesimal  number 
e  will  destroy  this  zero.  Thus  the  typical  zeros  of  a  typical  function  will  be  zero-crossings 
and  stable  under  .perturbations  of  the  function.  In  Morse  theory  these  intuitions  are  made 
precise:  typical  functions  are  Morse  functions  and  have  transversal  zero-crossings  which 
have  structually  stable  intersections  with  the  zero  axis.  For  our  purposes  this  result  means 
that  zeros  of  curvature  are  stable  if  they  are  zero-crossings. 

Note  that  if  we  had  adopted  the  definition  of  curvature  as  a  positive  function  there  would 
have  been  a  problem  of  defining  transversality  of  the  function  itself  with  respect  to  zero. 

We  now  consider  three  dimensional  perturbations  of  non-planar  curves.  We  will  consider 
curves  which  lie  on  a  cylinder  with  a  fixed  cylindrical  projection  onto  the  x,y  plane  (see 
fig.6). 

Varying  the  radius  of  the  cylinder  gives  us  a  one-parameter  family  of  non-planar  curves. 
Small  changes  of  the  radius  give  rise  to  small  non-planar  perturbations  of  the  curve. 

Let  7  be  a  planar  curve  whose  parametric  equations  are  x  =  x(t),  y  =  y(t),  where  t  is  the 
arc  length.  If  we  think  of  every  point  in  the  x,y  plane  as  being  the  projection  of  a  point 
lying  on  a  cylinder  of  radius  /I  whose  principal  axis  has  equation: 

1  =  0,  y  —  y,  z=R  (212) 

then  the  equations  of  the  curve  whose  cylindrical  projection  on  the  x,y  plane  gives  7 
are  (see  fig  .4): 


Xc  = 


linin 


[(0 
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Vc  --  y 
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FlQur«  See  text 


*«  =  H 

Notice  that  when  R  *->  +ao  the  first  order  approximation  of  Yc  flives: 

*c  =  *(t) 


»c  =  y(t) 


(2.M) 


*e  =  0. 

Therefore  when  H  is  large,  7^  can  be  seen  as  a  slight  3D  perturbation  of  7.  Let  us  now 
compute  ice,  the  curvature  of  7r-  Differentiating  (2.13)  gives: 


X,  - 


'^'(0 
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l4  =  »'(0 


(2.15) 


Notice  that  t  is  the  arc  length  for  Tfe  too  .since  i'*  +  Differentiating  (2.15)  we 

obtain: 


_//  _  ,  ®(0  ///i\ 

- ^  +  cos—x  (t) 


vl  =  y''(0 


(2.16) 


therefore 


// _  *(0*^*(0  I 

*  ~R — W~ 


«;= +•"•(<) +»*’(i). 
It  is  easy  to  show  that  (in  the  obvious  notation) 

_  *'*{«) 


and 


(2.17) 


(2.18) 


x''»(0  +  y"*(0  =  <,-  (2.19) 

Therefore  when  /c  =  0,  «e  =  0  if  and  only  If  x'  =  0,  I.e.  if  the  tangent  to  the  curve  at  the 
zero  of  curvature  is  parallel  to  the  cylindric  axis.  This  condition  is  usually  not  satisfied,  so 
2D  zeros  of  curvature  disappear  for  3D  perturbation. 

Despite  the  instability  of  the  2D  zeros  of  curvature  for  3D  perturbations,  since  projection  is 
a  mapping  from  to  we  can  recover  in  a  rough  sense  some  kind  of  stability  for  2D 
zeros  of  curvature.  In  fact  every  projection  of  a  small  3D  perturbation  of  a  planar  curve, 
which  had  a  zero  of  curvature,  shows  a  zero-crossing  of  curvature  in  the  neighbourhood 
of  the  corresponding  projected  point.  The  size  of  the  neighbourhood  will  depend  on  the 
deviation  of  the  surface  containing  the  curve  from  a  plane. 
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For  a  generic  30  curve  the  situation  is  more  complicated  since  it  is  not  possible  to  extend 
the  definition  of  sign  of  curvature  given  above.  As  an  example  consider  a  closed  smooth 
curve  lying  on  a  cylinder  such  that  there  is  only  one  point  with  a  zero  of  curvature  (a  curve 
similar  to  a  distorted  sine  wave  pattern  turned  in  on  itself).  Explicit  computations  in  this 
case  show  that  the  left  and  right  limits  of  the  binormal  at  that  point  have  the  same  direction 
but  opposite  sign:  however,  to  define  a  change  of  the  sign  of  curvature  here  leads  to  a 
contradictory  result  since  there  is  a  unique  such  point,  by  hypothesis,  on  the  curve. 

Moreover  it  is  worth  noticing  that  zeros  of  curvature  of  30  curves  are  extremely  uncommon 
points:  in  fact  looking  at  the  equations  it  is  clear  that  k  =  0  if  ic,  =  0  and  /ci/k2  = 

That  is  if,  given  the  surface  containing  the  curve,  the  ratio  of  the  two  principal  curvatures 
assumes  a  specific  value  at  a  specific  point. 

Summary 

We  have  shown  that  zeros  of  curvature  of  all  planar  curves  and  of  almost  all  non-planar 
curves  are  perspective  invariants.  The  zeros  of  curvature  of  planar  curves  are  shown  to  be 
structurally  stable  for  deformations  of  the  curve  in  the  plane.  This  property  still  holds  for 
small  deformations  out  of  the  plane  but  we  prove  that  it  vanishes  for  arbitrary  perturbations 
of  the  curve.  This  lack  of  structural  stability  puts  a  limit  on  the  usefulness  of  these  invariants 
for  non-planar  curves.  Note,  however,  this  is  stability  for  the  curve  itself:  if  the  curve  does 
have  zeros  they  will  be  projective  invariants. 

Zero  crossings  of  the  curvature  can  be  used  to  find  corresponding  points  for  stereo 
matching.  Their  use  is  limited  since  there  are,  in  general,  very  few  of  them.  They  can  be 
best  used  to  help  register  the  image  and  to  detect  if  an  object  enters  the  forbidden  zone. 

Finally  zero  crossings  are  useful  for  representing  image  curves  because  of  their  invariance 
under  both  perspective  projection  and  convolution  with  gaussian  niters. 
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